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SYSTEM FOR ENHANCING ACaUST-ieS 



TECHNICAL FIELD 

The invention comprises an in-line early reflection enhancement system and 
method for enhancing the acoustics of a room or auditorium. 

BACKGROUND 

The acoustics of a room has a significant impact on an audience's perception of the 
quality of a live performance. There are a number of properties of rooms that have 
been identified as being correlated to subjective impressions of quality. The earliest 
measured parameter was the reverberation time. This is a global property of the 
room which has a similar value at all locations. It is governed by the room volume 
and the absorption of the room surfaces, and the quality of reverberation is also 
governed by the room shape. Rooms with a long reverberation time can provide a- 
sense of envelopment which produces an increased enjoyment of performances 
such as opera or classical music. However, the same acoustics can reduce the 
intelligibility of the spoken word, and therefore be unsuitable for speech. 

Other parameters have been determined which relate to the properties of the early 
part of the response, such as the clarity. More recent auditoria have been designed 
with reflectors specifically placed to enhance the early part of the room response to 
sounds emanating from the stage. 

To achieve maximum enjoyment of a variety of performances, the acoustics of a 
room must be matched to the intended performance. Many rooms have for this 
reason been made acoustically adjustable. For example adjustable absorbers such 
as moveable curtains or rotatable panels have been used to control reverberation 
time. Extra acoustic spaces have been constructed which can be coupled to the 
main area when required to provide more reverberance. 
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Electroacoustic systems have been used for many years to enhance the acoustics of 
rooms. The simplest system is the public address or sound reinforcement system, in 
which the sound produced by performers on stage is detected by close microphones 
and the sound amplified and broadcast from one or more sets of loudspeakers. The 
5 goal of such systems is typically to project the direct, unreverberated, sound to the 
audience to eliminate the effects of the room and improve clarity. 

More recently, more complex forms of sound system have been developed which aim 
to provide adjustable room acoustics. The basic sound reinforcement system has 

10 been further developed by introducing sound processing elements such as delays, 
which allow the creation of additional sound reflections - see W. Anhert, "Complex 
simulation of acoustic fields by the delta stereophony system (DDS),* J. Audio Eng: 
Soc, vol. 35, no. 9, pp 643-652, September 1987, and US patent 5,142,586. The 
delta stereophony system described by Anhert provides sound reflections that are 

15 arranged to arrive later than the direct sound, in order to maintain correct 
localisation. For a given receiver location, the appropriate delays can be chosen to 
avoid preceding the direct sound, but the delays must be changed for different 
receiver positions. The ACS system described in US patent 5,142,586 claims to' 
provide reflections at the appropriate times for all receiver positions, by the creation 

20 of wavefronts. The delays are chosen using Huygens principle, and their 
quantification mathematically by integral equations is described by A. J. Bericnout, 
D. de Vries, and P. Vogel, u Acoustic control by wave field synthesis,* Jl Acoust Soc. 
Anu, vol. 93, no, 5, pp 2764-2778, May 1993. The wavefronts are generated using 
loudspeaker arrays. These electroacoustic systems offer a more controllable early 

25 reflection response than can be achieved using passive reflectors. 

Reverberators have also been introduced to provide a larger reverberation time for 
sources on stage - see for example US patent 5,109,419. Larger numbers of 
speakers have also been employed to provide enhanced reflections $nd 
30 reverberation, such as to under balcony areas. The microphones have also been 
positioned further from the performers so as to be less obtrusive, while still aiming 
to detect the direct sound. 

The systems discussed above avoid feedback from the loudspeakers to the 
35 microphones, since such feedback can lead to colouration and instability if the loop 
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gain is too high. Because of this fact, they may be generically termed in-line, or non- 
regenerative, systems. Such systems can provide large increases in reverberation for 
sound sources that are close to the microphones (ie on stage), but they have a small 
effect for sound sources at other positions in the room. 

A second type of enhancement system is the non-in-line, or regenerative, system, 
which seeks to utilise the feedback between loudspeakers and microphones to 
achieve a global enhancement of reverberation that occurs for any sound source 
position - see A. Krokstad, "Electroacoustic means of controlling auditorium 
acoustics," Applied Acoustics, vol. 24, pp 275-288, 1998 and F. Kawakami and Y. 
Shimizu, "Active field control in auditorial Applied Acoustics, vol 31, pp 47-75, 
1990. Since the natural, unassisted reverberation time is largely the same for alT 
source positions, the regenerative systems can provide a more natural enhanced 
reverberation. Non-in-line systems typically use a large number of independent 
microphone, amplifier, loudspeaker channels, each with a low loop gain. Each 
channel provides a small enhancement of reverberation at all frequencies, with low 
risk of colouration, and the combined effect of all the channels is a significant 
increase in reverberation and loudness. The microphones are positioned in the 
reverberant field from all sound sources in the room to ensure that the system 
produces. a similar enhancement for all sources. Non-in-line systems, however, 
have typically required from 60 to 120 channels, and have therefore been expensive. 
Furthermore, since the microphones are remote from all sources, they are less 
suited to providing significant early reflections than in-line systems. 

25 More recently, a non-in-line system has been developed which uses a multichannel 
reverberator between the microphones and loudspeakers to provide an increase in 
reverberation time without requiring an increase in loop gain - see US patent 
5,862,233. It has been shown that the system can both reduce the apparent room 
absorption (by increasing the loop gain) and increase the apparent room volume jby 
increasing the reverberation time of the reverberator) - see M. A. Poletti, 'The 
performance of a new assisted reverberation system," Acta Acustica, 2 December 
1994, pp 511-524. In general, a hybrid room enhancement system may be 
constructed in which some of the microphones of a non-in-line system containing a 
reverberator are moved close to the source. In this case the system demonstrates 
35 properties of both in-line and non-in-line systems - see M. A. Poletti, The analysis 
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of a general assisted reverberation system,* accepted for publication in Acta Acustica 
vol. 84, pp 766-775, 1998. 

When used solely for early reflection enhancement, an in-line system provides a 
5 finite number of delayed outputs to simulate early reflections. However, if operated 
at moderate to high gains, the system runs the risk of instability. This is particularly 
likely if new delays/reflections are added which will increase the loop gain at some 
frequencies. 

10 In any sound system, it is important that the direct acoustic sound from the stage 
amves at every member of the audience before (or at the same time as) any 
electroacoustic signal. This is because the perception of localisation is governed by 
the first signal to arrive at the ears (provided later signals are not overly large). 
Hence, care must be taken in both in-line and non-in-line systems to ensure that 

15 the electroacoustic signals are suitably delayed. In a non-in-line system this can be 
achieved by keeping the microphones a suitable distance from the stage. Delays can 
be used in in-line systems and non-in-line systems to avoid preceding the direct 
sound. Care must therefore be taken in any non-in-line system where microphones 
are moved close to the stage. 

J20 

SUMMARY OF INVENTION 

In broad terms in one aspect the invention comprises an in-line early reflection 
generation system comprising: 

25 one or more microphones positioned close to one or more sound sources so as to 
detect predominantly direct sound; 

an early reflection generation stage which generates a number of delayed 
reproductions of the microphone signals and which has unitary power gain whereby 
the stability of the system is independent of the delay times and amplitudes; 

30 a number of loudspeakers placed to broadcast the early reflected energy into the 
room. 
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The in-line early reflection generation stage may include a number of delay lines 
which are preceded or followed by cross coupling matrices. 

The system and method of the invention do not attempt to optimise the delay time 
for individual receiver positions as in delta stereophony, nor create wavefronts as in 
the ACS system. Instead, early reflections are generated in such a way that the 
stability of the system is maximised. This is achieved by ensuring that the reflection 
generation circuit has a unitary property. 

In the system and method of the invention unitary circuit principles are applied to 
an in-line reflection generation system. In any early reflection system there is a 
finite level feedback of sound from the loudspeakers to the microphones via the 
reverberant field in the room. The generation of multiple reflections via multiple 
delays and amplitude weightings in prior art early reflection systems increases the 
risk of instability by creating variations in the loop gain both below and above the 
levels that would have existed without the system. 

However, if the system has a transfer function matrix which is unitary, then the ' 
power gain of the system is one at all frequencies, and the stability of the sound 
system is. not compromised by the insertion of the early reflection system. 

Suppose the matrix of transfer functions through the early reflection system is X(f). 
The unitary property states that 

X H X = I 1 

where the H superscript denotes the conjugate transpose of the matrix. Consider a 
single frequency f 0 applied to each input of X, with amplitude A n and phase $ n . The 
input signal Sm(t) may be written 



where u is the complex amplitude vector 



WO 99/54867 



PCT/NZ99/00049 



The total output power is 

5 y H {t)y(t) = u B X H {f 1i )X(J 0 )u = u H u 4 

since X is unitary. Hence, the power gain of a unitary system is one at all 
frequencies, and does not affect stability when inserted into a multichannel system 
which contains feedback. 

10 

US patent number 5,729,613 describes a multi-channel reverberator which has this 
unitary property. This device provides multiple channels of reverberation while 
maintaining a constant power gain with frequency, and is designed for application 
in a non-in-line system for reverberation time enhancement, as described in US 
15 patent 5,862,233. The device contains multiple channels of internal feedback which 
creates an infinitely long decaying response, and a rapidly increasing density of 
echoes which are perceived as reverberation. 

In this invention early reflection systems are disclosed which also have a unitary 
20 property. They are distinguished from the unitary reverberator in that they do not 
contain internal feedback, and do not produce an infinite decaying response. 
Instead they produce a finite response consisting of a relatively low number of 
discrete echoes. The response is therefore not perceived as reverberation, 

25 It is important to note that in the unitary early reflection system of the invention 
there is no recursion in the reflection system, ie there is not feedback of the outputs 
of delay lines to the inputs of delay lines. In contrast to a reverberator the response 
of the reflection system is therefore finite - the response to an impulse is a short 
burst of echoes then silence. Also, the density of the echoes will never reach that of 

30 a reverberator. Typically system of the invention will have a response time of only 
80ms or so, and the echo density never reaches that of a reverberator. 
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BRIEF DESCRIPTION OF THE FIGURES 

The invention is further described with reference to the accompanying figures, by 

way of example and without intending to be limiting, in which: 

5 

Figure 1 shows the layout of an early reflection system of the invention, 

Figure 2 shows a unitary n-channel delay line system as the early reflection 
generation stage, 

10 

Figure 3 shows a unitary cross-coupled n-channel delay system including an 
orthononnal matrix before the delay lines as the early reflection generation stage, 

Figure 4 shows a unitary dual cross-coupled n-channel delay system using 
15 orthononnal matrices both before and after the delay lines as the early reflection 
generation stage, 

Figure 5 shows a two stage unitary dual cross-coupled n-channel delay system with * 
cascaded orthononnal matrices and delay lines between each two matrices as the 
20 early reflection generation stage, and 

Figure 6 shows a non-in-line assisted reverberation system for controlling the global 
reverberation time of a room or auditorium with which the in-line early reflection 
system of the invention may be combined. 

25 

DETAILED DESCRIPTION OF PREFERRED FORMS 

Figure 1 shows the layout of an early reflection system of the invention. A number of 
microphones mi to mN are positioned close to the sources on stage. The microphone 
30 signals are fed to a processor which generates a number of scaled and delayed 
replicas of the N microphone signals, and the processor outputs are fed to amplifiers 
and loudspeakers Li to Lk placed in the room. The transfer function matrix of the 
processor is denoted X(f). 
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The microphones are typically directional, that is, they are sensitive to sound 
sources positioned on axis, and tend to suppress sound sources (and reflections 
and reverberation) which are positioned off-axis. This maximises the direct sound 
pickup and reduces the risk of feedback from the loudspeakers. However, a finite 
5 level of feedback may still exist, and if the loop gain of the system is too high, the 
system will become unstable. The transfer function matrix from the loudspeakers to 
the microphones is H(f), and the loop transfer function matrix is thus H(f)X(f). If the 
locus of any eigenfunction of H(f)X(f) encircles the point (1+jO), the system will be 
unstable. 

10 

The stability of the system can be maintained by keeping the loop gain low, for 
example by keeping the amplifier or microphone preamplifier gains low. However, for" 
a given setting of amplifier gains, the stability of the system is dependent on the 
particular delay times and delay levels in the processor. Hence, the system stability 
15 cannot be guaranteed once the amplifier gains are set. However, if X{f) has a 
unitary property, its power gain is unity at all frequencies. The stability is then 
independent of the delay times and levels. 

Unitary early reflection systems of the invention may be constructed using non- 
20 cross-coupling delay lines and orthonormal cross coupling matrices. The simplest N 
channel system comprises N delay lines connecting N microphone signals to N 
loudspeakers, as shown in figure 2. This system generates a single delay at each 
output for a signal applied to its respective input. The transfer function matrix is 



exp{-ja>7;} 0 0 
0 exp{-;#T 2 } 0 
0 0 exp{-y<yr 3 } 



0 
0 



0 
0 



0 
0 



0 
0 
0 

cxp{-ja)T N ) 



This has a diagonal form since there is no cross coupling. The system is unitary 
since D H D=L 



30 Figure 3 shows the use of an orthonormal cross coupling matrix in a more complex 
system of the invention. An orthonormal matrix Mi is placed before the delay lines 
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Ti-Tn so that a signal applied to any one input is coupled into every delay line, 
resulting in a single scaled and delayed reproduction of that signal at every output. 
The transfer function matrix is 



10 



15 



:20 



35 



30 



X = DM X 6 

This system is unitary since both Mi and D are unitary, and the product of unitary 
matrices is unitary. 

Figure 4 shows the use of orthonormal matrices Mi and M 2 both before and after the 
delay lines Ti and T N . A single impulse applied to one of the inputs is applied to all 
N delay line inputs, and appears at times x„ later at the delay outputs. The N 
delayed impulses are then cross coupled to every output. Thus, N output delays are 
generated at each output for a single applied impulse. The circuit thus has the 
property of diffusing the inputs and providing the maximum number of outputs for 
any input. The matrix transfer function of the circuit is the product of the transfer 
function matrices of each section 

X = M 2 DM l 7 

Figure 5 shows cascading multiple systems of the form in figure 4. This system 
generates N2 scaled delayed reproductions of a signal applied to any single input at 
every output. Hence the delay density increases rapidly with the number of delay 
stages. 

The early reflection enhancement system of the invention may also be combined 
with a non-in-line assisted reverberation system for controlling the global 
reverberation time so that the reverberation time is similar for all source positions 
in the room, of the type described in US patent 5,862,233. Such a system comprises 
multiple microphones positioned to pick up predominantly reverberant sound in a 
room, multiple loud speakers to broadcast sound into the room, and a reverberation 
matrix connecting a similar bandwidth signal from each microphone through a 
reverberator having an impulse response consisting of a number of echoes the 
density of which increases over time, to a loudspeaker. The reverberation matrix 
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may connect a similar bandwidth signal from each microphone through one or more 
reverberators to two or more separate loudspeakers and each of which receives a 
signal comprising one or more reverberated microphone signal. Figure 6 shows a 
wideband, N microphone, K loudspeaker non-in-line system. Each of microphones, 
5 mi, m2 and m3 picks up the reverberant sound in the auditorium. Each microphone 
signal is split into a number of K of separate paths, and each 'copy' of the 
microphone signal is transmitted through a reverberator, (the reverberators typically 
have a similar reverberation time but may have a different reverberation time). 
Each microphone signal is connected to each of K loudspeakers through the 

10 reverberators, with the output of one reverberator from each microphone being 
connected to each of the amplifiers Ai to A3 and to loudspeakers Li to L3 as shown ie 
one reverberator signal from each microphone is connected to each loudspeaker and 
each loudspeaker has connected to it the signal from each microphone, through a 
reverberator. In total there are N.K connections between the microphone and the 

15 loudspeakers. While in Figure 6 each microphone signal is split into K separate 
paths through K reverberators resulting in N.K connections to K amplifiers and 
loudspeakers, the microphone signals could be split into less than K paths and 
coupled over less than K reverberators, ie each loudspeaker may have connected to 
it the signal from at least two microphones each through a reverberator, but be 

20 cross-linked with less than the total number if microphones. For example, in the 
system of Figure 2 the reverberation matrix may split the signal from each of 
microphones mi, ma and 213 to feed two reverberators instead of three, and the 
reverberator output from microphone mi may then be connected to speakers Li and 
L3, from microphone m2 to speakers L3 and L2, and from microphone 1113 to speakers 

25 Iq and L3. It can be shown that the system performance is governed by the 
minimum of N and K, and so systems of the invention where N=K are preferred. In 
Figure 6 each loudspeaker indicated by Li, la and L3 could in fact consist of a group 
of two or more loudspeakers positioned around an auditorium. In Figure 6 the 
signal from the microphones is split prior to the reverberators but the same system 

30 can be implemented by passing the supply from each microphone through a single 
reverberator per microphone and then splitting the reverberated microphone signal 
to the loudspeakers. 

The system simulates placing a secondary room in a feedback loop around the main 
35 auditorium with no -two way acoustic coupling. The system allows the 
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reverberation time in the room to be controlled independently of the steady state 
density by altering the apparent room volume. 

The foregoing describes the invention including preferred forms thereof. Alterations 
and modifications as will be obvious to those skilled in the art are intended to be 
incorporated within the scope hereof. 
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CLAIMS 



1 . An in-line early enhancement generation system comprising: 

one or more microphones positioned close to one or more sound sources so 
as to detect predominantly direct sound; 

an early reflection generation stage which generates a number of delayed 
reproductions of the microphone signals and which has unitary power gain 
whereby the stability of the system is independent of the delay times and 
amplitudes; 

a number of loudspeakers placed to broadcast said early reflected energy 
into the room. 

2. An in-line early reflection enhancement system according to claim 1 
wherein the early reflection generation stage also includes at least one cross 
coupling matrix. 

3. An in-line early reflection enhancement system according to claim 1 
wherein the early reflection generation stage includes a series connection of 
two or more cross-coupling matrices with a set of delay lines positioned 
between the two matrices. 

4. An in-line early reflection generation system according to claim 2 or claim 3 
wherein said cross-coupling matrix or matrices are orthonormal matrices, 

5. An in-line early reflection generation system according to claim 1 wherein 
each input is coupled to every output to provide a maximisation of diffusion 
of the input signals to all of the outputs. 

6. An in-line early reflection enhancement system according to any one of 
claims 1 to 5 in combination with a wideband non-in-line assisted 
reverberation system which increases apparent room volume, including 
multiple loudspeakers to broadcast sound into the room, and a 
reverberation matrix connecting a similar bandwidth signal from each 
microphone through one or more reverberators having an impulse response 
consisting of a number of echoes the density of which increases over time, 
to one or more loudspeakers. 
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An in-line early reflection enhancement system according to claim 6 
wherein in said wideband non-in-line assisted reverberation system the 
reverberation matrix connects a similar bandwidth signal from each 

microphone through one or more reverberators to at least two loudspeakers 
each of which receives a signal comprising a sum of at least two 
reverberated microphone signals. 

A method for enhancing the acoustics of a room or auditorium comprising 
detecting predominantly direct sound with one or more microphones 
positioned close to one or more sound sources, generating a number of 
delayed reproductions of the microphone signals in an early reflection 
generation stage and which has unitary power gain whereby the stability of 
the system is independent of the delay times and amplitudes, and 
broadcasting said early reflected energy into the room. 

A method according to claim 8 wherein the early reflection generation stage 
includes at least one cross coupling matrix. 

A method according to claim 8 wherein the early reflection generation stage ' 
includes a series connection of two or more cross-coupling matrices with a 
set of delay lines position between the two matrices. 

A method according to claim 9 or claim 10 wherein said cross-coupling 
matrix or matrices are orthonormal matrices. 

A method according to claim 8 wherein each input is coupled to every 
output to provide a maximisation of diffusion of the input signals to all of 
the outputs. 
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